Creating learning health systems and the emerging role of biomedical informatics.

INTRODUCTION: The nature of information used in medicine has changed. In the past, we were limited to routine clinical data and published clinical trials. Today, we deal with massive, multiple data streams and easy access to new tests, ideas, and capabilities to process them. Whereas in the past getting information for decision-making was a challenge, now, it is how to analyze, evaluate and prioritize all that is readily available through the multitude of data-collecting devices. Clinicians must become adept with the tools needed to deal with the era of big data, requiring a major change in how we learn to make decisions. Major change is often met with resistance and questions about value. A Learning Health System is an enabler to encourage the development of such tools and demonstrate value in improved decision-making. METHODS: We describe how we are developing a Biomedical Informatics program to help our medical institution's evolution as an academic Learning Health System, including strategy, training for house staff and examples of the role of informatics from operations to research. RESULTS: We described an array of learning health system implementations and educational programs to improve healthcare and prepare a cadre of physicians with basic information technology skills. The programs have been well accepted with, for example, increasing interest and enrollment in the educational programs. CONCLUSIONS: We are now in an era when large volumes of a wide variety of data are readily available. The challenge is not so much in the acquisition of data, but in assessing the quality, relevance and value of the data. The data we can get may not be the data we need. In the past, sources of data were limited, and trial results published in journals were the major source of evidence for decision making. The advent of powerful analytics systems has changed the concept of evidence. Clinicians will have to develop the skills necessary to work in the era of big data. It is not reasonable to expect that all clinicians will also be data scientists. However, understanding the role of AI and predictive analytics, and how to apply them, will become progressively more important. Programs such as the one being implemented at Wake Forest fill that need.

Identifying and Investigating Unexpected Response to Treatment: A Diabetes Case Study.

The availability of electronic health records creates fertile ground for developing computational models of various medical conditions. We present a new approach for detecting and analyzing patients with unexpected responses to treatment, building on machine learning and statistical methodology. Given a specific patient, we compute a statistical score for the deviation of the patient's response from responses observed in other patients having similar characteristics and medication regimens. These scores are used to define cohorts of patients showing deviant responses. Statistical tests are then applied to identify clinical features that correlate with these cohorts. We implement this methodology in a tool that is designed to assist researchers in the pharmaceutical field to uncover new features associated with reduced response to a treatment. It can also aid physicians by flagging patients who are not responding to treatment as expected and hence deserve more attention. The tool provides comprehensive visualizations of the analysis results and the supporting data, both at the cohort level and at the level of individual patients. We demonstrate the utility of our methodology and tool in a population of type II diabetic patients, treated with antidiabetic drugs, and monitored by the HbA1C test.

A system for identifying and investigating unexpected response to treatment.

The availability of electronic health records creates fertile ground for developing computational models for various medical conditions. Using machine learning, we can detect patients with unexpected responses to treatment and provide statistical testing and visualization tools to help further analysis. The new system was developed to help researchers uncover new features associated with reduced response to treatment, and to aid physicians in identifying patients that are not responding to treatment as expected and hence deserve more attention. The solution computes a statistical score for the deviation of a given patient's response from responses observed individuals with similar characteristics and medication regimens. Statistical tests are then applied to identify clinical features that correlate with cohorts of patients showing deviant responses. The results provide comprehensive visualizations, both at the cohort and the individual patient levels. We demonstrate the utility of this system in a population of diabetic patients.

Leveraging medical thesauri and physician feedback for improving medical literature retrieval for case queries.

OBJECTIVE: This paper presents a study of methods for medical literature retrieval for case queries, in which the goal is to retrieve literature articles similar to a given patient case. In particular, it focuses on analyzing the performance of state-of-the-art general retrieval methods and improving them by the use of medical thesauri and physician feedback. MATERIALS AND METHODS: The Kullback-Leibler divergence retrieval model with Dirichlet smoothing is used as the state-of-the-art general retrieval method. Pseudorelevance feedback and term weighing methods are proposed by leveraging MeSH and UMLS thesauri. Evaluation is performed on a test collection recently created for the ImageCLEF medical case retrieval challenge. RESULTS: Experimental results show that a well-tuned state-of-the-art general retrieval model achieves a mean average precision of 0.2754, but the performance can be improved by over 40% to 0.3980, through the proposed methods. DISCUSSION: The results over the ImageCLEF test collection, which is currently the best collection available for the task, are encouraging. There are, however, limitations due to small evaluation set size. The analysis shows that further refinement of the methods is necessary before they can be really useful in a clinical setting. CONCLUSION: Medical case-based literature retrieval is a critical search application that presents a number of unique challenges. This analysis shows that the state-of-the-art general retrieval models are reasonably good for the task, but the performance can be significantly improved by developing new task-specific retrieval models that incorporate medical thesauri and physician feedback.